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1 

CONTROL OF VIDEO LEVEL 
BY REGION AND CONTENT OF INFORMATION DISPLAYED 

5 The present invention relates to the display of alphanumeric or 

graphic information by an image reproducing device such as a kinescope, 
and, in particular, to a system and method for controlling the video level 
of an image reproducing device depending on the region and the content 
of the information being displayed. 

10 

Electronic devices such as televisions and personal computers (PC) 
typically require a video monitor and associated video display 
controller/processor for displaying images so that information can by 
conveyed to the users. The present inventor has recognized that, 
15 however, the differences in the nature and the content of the material to 
be shown place disparate requirements on the display. For example, two 
types of material with different requirements are: 

1. Text and line-oriented graphics: These require very sharp video 
20 edges, such as black-to-white and white-to-black transitions, and 

therefore, need a very well-focused, crisp display. These types of 
materials also tend to have a large percentage of their content displayed 
at full brightness. Black text on white background is typical, simulating 
print media on white paper. Since cathode-ray-tubes tend to have larger 
25 electron spots at high currents, causing "blooming" and poorer focus, these 
types of material should be displayed at lower beam currents. This is 
typical of the way that computer desktop monitors are operated. 

2. Real-world photographic-style or television broadcast images: 
30 These tend to naturally have softer edges, and so do not have the same 

requirement for the very sharp focus that text and line graphics do. It is 
another characteristic of this material that it typically has a lower duty 
cycle of high brightness material (i.e., most of the video is not at full 
brightness), but a few bright peaks are required to give the material a 
35 realistic "punch" and vividness. This is typical of the way that commercial 
television receivers are operated. To obtain that realism, the highest level 
of brightness for this type of material should be displayed at a higher 
brightness level than the text and graphics as described above. 
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The present inventor has recognized that a problem arises when a 
display must exhibit both types of material, each of which has its own 
requirements. This type of setup is found for example, in a device which 
combines the functions of a personal computer (PC) with a television. For 
5 example, a personal computer can be outfitted with a television tuner 
card, so that a user may watch a television program in one window of 
provided by the computer's graphical operating system (e.g., Microsoft 
Windows 95®), while working on a spread sheet application displayed in 
another window. Another example is a television receiver which is also 
10 being used as a PC monitor or has built-in PC capabilities for surfing the 
internet or performing other computing functions. Video drive level 
adjustments need to be made to optimize each of the material being 
displayed. 

1 5 Another situation where a display must exhibit both types of 

material is, for example, when a television has an electronic program 
guide or some other text/graphical On Screen Display (OSD) information 
that needs to be conveyed to the users, along with real-world, television 
broadcast information. In addition, such a television may include internet 

20 access so that computer graphics and text can be downloaded from the 

internet for viewing on the television display. The computer graphics and 
text may be displayed, for example, in a subpicture of a television with a 
Picture-in-Picture (PIP) or Picture-out-of-Picture (POP) capability, while 
the main picture is showing the television broadcast channel. These 

25 different viewing materials may each require a different drive level to 
provide the proper picture on the same screen. 

The inventor has recognized that drive level adjustment between 
two or more types of material may be made manually, if only one is 

30 shown on the display at a time. This might be done with the monitor's 
contrast control, for example. However, with systems such as those that 
combine the functionality of a PC and TV, it is common that more than 
one type of material will appear on the screen simultaneously. For this 
reason, it is desirable for the system to be able to adjust the video drives 

35 for each type of the display material in each region of the display screen 
automatically and independently, depending on the content of the 
material being displayed. 

Accordingly, a video processing system and method is provided for 
40 presenting an image having more than one region on a display. The 
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system has a control processor which can determine, for each region, the 
type (e.g., graphics, text, computer programs, broadcast TV video, etc.) of 
the image material being displayed in the region. The system also has a 
video driver coupled to the display for providing image signals having 
5 contrast and brightness characteristics. The control processor generates a 
control signal for causing the video driver to adjust the contrast and 
brightness characteristics of the image signals according to the type of 
material being displayed in the region. 

10 Another aspect of the present invention provides for manual 

adjustment of the image characteristics for each of the regions 
independently, therefore, allowing a user to adjust the drive level for 
each region to suit his or her own taste. 

1 5 The invention will be further explained by reference to the 

drawings in which: 

FIG. 1 shows a block diagram of a television incorporating the 
principals of the present invention; 

FIG. 2 shows the steps of an exemplary process to accomplish the 
20 present invention; 

FIG. 3 is a block diagram of an exemplary PC which incorporates the 
principals of the present invention; 

FIG. 4 is another exemplary process for implementing the present 
invention; 

25 FIGS. 5A and 5B depicts displays having different materials being 

shown in different regions in accordance with the present invention; and 

FIG. 6 is an example of a subroutine which allows a user to adjust 
the drive level for each of the regions being displayed. 

30 FIG. 1 shows a television receiver receiving for processing both 

analog NTSC television signals and internet information . The system 
shown in FIG* 1 has a first input 1100 for receiving television signal 
RF_IN at RF frequencies and a second input 1 102 for receiving baseband 
television signal VIDEO IN. Signal RF_IN may be supplied from a source 

3 5 such as an antenna or cable system while signal VIDEO IN may be 

supplied, for example, by a video cassette recorder (VCR) or a gaming 
device (both not shown in FIG. 1). Tuner 1105 and IF processor 1130 
operate in a conventional manner for tuning and demodulating a 
particular television signal that is included in signal RF_IN. IF processor 

40 1 130 produces baseband video signal VIDEO representing the video 
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program portion of the tuned television signal. IF processor 1130 also 
produces a baseband audio signal that is coupled to an audio processing 
section (not shown in FIG. 1) for further audio processing. Although FIG. 
1 shows input 1102 as a baseband signal, the television receiver could 
5 include a second tuner and IF processor similar to units 1 105 and 1 130 
for producing a second baseband video signal from either signal RF_IN or 
from a second RF signal source. 

The system shown in FIG. 1 also includes a main microprocessor 

10 (jiP) 1110 for controlling components of the television receiver such as 
tuner 1105, picture-in-picture processing unit 1140, video signal 
processor 1155, and StarSight® data processing module 1160. As used 
herein, the term "microprocessor" represents various devices including, 
but not limited to, microprocessors, microcomputers, microcontrollers, 

15 control processors, and controllers. Microprocessor 1110 controls the 

system by sending and receiving both commands and data via serial data 
bus I 2 C BUS which utilizes the well-known I 2 C serial data bus protocol. 
More specifically, central processing unit (CPU) 1112 within nP 1110 
executes control programs contained within memory, such as EEPROM 

20 1127 shown in FIG. 1, in response to commands provided by a user, e.g., 
via IR remote control 1125 and IR receiver 1 122. For example, activation 
of a "CHANNEL UP" feature on remote control 1125 causes CPU 1112 to 
send a "change channel" command along with channel data to tuner 1 105 
via I 2 C BUS. As a result, tuner 1105 tunes the next channel in the 

25 channel scan list. The control program stored in EEPROM 1127 also 
includes software for implementing the operations shown in FIG. 2. 

Main microprocessor 1110 also controls the operation of a 
communications interface unit 1113 for providing the capability to 

30 download and upload information from the internet. Communication 
interface unit 1113 includes, for example, a modem for connecting to an 
internet service provider, e.g., via a telephone line or via a cable 
television line. The communication capability allows the system shown in 
Figure 1 to provide email capability and internet related features such as 

35 web browsing in addition to receiving television programming. 

CPU 1112 controls functions included within uP 1 1 10 via bus 1119 
within \x? 1110. In particular, CPU 1112 controls auxiliary data processor 
1115 and on-screen display (OSD) processor 1117. One function of the 
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auxiliary data processor 11 15 is to extract auxiliary data such as 
StarSight® data from video signal PIPV. 

StarSight® system is an Electronic Program Guide (EPG) provided by 
5 StarSight Telecast, Inc. An EPG is an interactive, on-screen equivalent to 
TV listings found in local newspapers or other print media. The 
information contained in an EPG includes programming characteristics 
such as channel number, program title, start time, end time, elapsed time, 
time remaining, rating (if available), topic, theme, and a brief description 
10 of the program's content. Aspects of the StarSight® system are described 
in US Pat. Nos. 5,353,121, 5,479,268, and 5,479,266 issued to Young et al. 
and assigned to StarSight Telecast, Inc. 

StarSight® data is typically received only on a particular television 
15 channel and the television receiver must tune that channel to extract 
StarSight® data. To prevent StarSight® data extraction from interfering 
with normal use of the television receiver, CPU 1112 initiates StarSight® 
data extraction by tuning the particular channel only during a time period 
when the television receiver is usually not in use (e.g., 2:00 AM). At that 
20 time, CPU 1112 configures decoder 1115 such that auxiliary data is 

extracted from horizontal line intervals such as line 16 that are used for 
StarSight® data. CPU 1112 controls the transfer of extracted StarSight® 
data from decoder 1115 via I 2 C BUS to StarSight® module 1160. A 
processor internal to the module formats and stores the data in memory 
25 within the module. In response to the StarSight® EPG display being 

activated (e.g., a user activating a particular key on remote control 125), 
CPU 1112 transfers formatted StarSight® EPG display data from 
StarSight® module 1 160 via I 2 C BUS to OSD processor 1 117. 

30 OSD processor 1117 operates in a conventional manner to produce 

R, G, and B video signals OSD_RGB that, when coupled to a display device, 
will produce a displayed image representing on-screen display 
information such as graphics and/or text comprising an EPG or graphics 
and/or text downloaded from internet as described below. OSD processor 

35 1117 also produces control signal FSW which is intended to control a fast 
switch for inserting signals OSD_RGB into the system's video output signal 
at times when an on-screen display is to be displayed. For example, 
when a user enables an EPG, e.g., by activating a particular switch on 
remote control 1125, CPU 1112 enables processors 1115 and 1117 so that 

40 processor 1115 first requests and receives EPG data from StarSight® 
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module 1160 via I 2 C BUS. Processor 1117 then produces signals OSD_RGB 
representing the closed caption data. Processor 1117 also produces signal 
FSW indicating when the EPG is to be displayed. 

5 Another function of the OSD processor 1 1 10 is to generate computer 

text or graphics obtained from the internet, in cooperation with the 
communication interface unit 1113 and the Auxiliary Data Processor 
1115. The communication interface unit 1113 demodulates the analog 
information into digital format and passes it to the Auxiliary Data 

10 Processor 1 1 15 for further processing. The OSD processor then formats 
this digital information into RGB signals suitable for used by the Video 
Signal Processor 1155. As described above, the OSD produces control 
signal FSW which is intended to control a fast switch for inserting signals 
OSD_RGB into the system's video output signal at times when internet 

1 5 graphics and text is to be displayed. 

Video signal processor (VSP) 1155 performs conventional video 
signal processing functions, such as luma and chroma processing and 
contrast and brightness adjustment. Output image signals produced by 

20 VSP 1 155 are suitable for coupling to a display device, e.g., a kinescope or 
LCD device (not shown in FIG. 1), for producing a displayed image. VSP 
1155 also includes a fast switch for coupling signals produced by OSD 
processor 1117 to the output video signal path at times when graphics 
and/or text is to be included in the displayed image. The fast switch is 

25 controlled by control signal FSW which is generated by OSD processor 
1117 in main microprocessor 1110 at times when text and/ or graphics 
are to be displayed. 

The input signal for VSP 1155 is signal PIPV that is output by 
30 picture-in-picture (PIP) processor 1140. When a user activates PIP 
mode, signal PIPV represents a large picture (large pix) into which a 
small picture (small pix) is inset. When PIP mode is inactive, signal PIPV 
represents just the large pix, i.e., no small pix signal is included in signal 
PIPV. PIP processor 1140 provides the described functionality in a 
35 conventional manner using features included in unit 1 140 such as a video 
switch, analog-to-digital converter (ADC), RAM, and digital to analog 
converter (DAC). 

As described above, and as shown in FIG. 5 A, the subpicture 501 of 
40 the PIP image 500 of the television may be used to present text and/or 
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graphics information from the internet, or text and/or graphics 
information from the EPG while the main picture 502 is showing a TV 
broadcast channel. This is accomplished by feeding the processed digital 
signals from the OSD processor 1117 directly to one of the inputs of the 
5 PIP processor. As it is well known in the art, the video switch typically 
contained in the PIP processor 1140 receives all the signal inputs (e.g., 
VIDEO, VIDEO IN, and signal from OSD as shown in FIG. 1). Then the PIP 
processor under the control of the main microprocessor 1110, selects and 
switches the appropriate signals to be displayed during the appropriate 
10 main and subpicture scanning intervals. Conventional subsampling 
techniques are used to form the subpicture. 

For an EPG display, the display data included in the EPG display is 
produced by OSD processor 1117 and included in the output signal by 

15 VSP 1155 in response to fast switch signal FSW. When controller 1110 
detects activation of the EPG display, e.g., when a user presses the 
appropriate key on remote control 1125, controller 1110 causes OSD 
processor 1117 to produce the EPG display using information such as 
program guide data from StarSight® module 1160. Controller 1110 

20 causes VSP 1155 to combine the EPG display data from OSD processor 
1117 and the video image signal in response to signal FSW to produce a 
display including EPG. The EPG can occupy all or only a portion of the 
display area. 

25 When the EPG display is active, controller 1110 executes another 

control program stored in EEPROM 1127. The control program monitors 
the location of a position indicator, such as a cursor and/or highlighting, in 
the EPG display. A user controls the location of the position indicator 
using direction and selection keys of remote control 1125. Alternatively, 

30 the system could include a mouse device. Controller 1110 detects 
activation of a selection device, such as clicking a mouse button, and 
evaluates current cursor location information in conjunction with EPG 
data being displayed to determine the function desired, e.g., tuning a 
particular program. Controller 1110 subsequentiy activates the control 

35 action associated with the selected feature. 

Examples of suitable components for implementing the exemplary 
embodiment include an ST9296 microprocessor produced by SGS- 
Thomson Microelectronics for providing the features associated with jxP 
40 1 110; an M65616 picture-in-picture processor produced by Mitsubishi 
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for providing the described basic PIP functionality associated with PIP 
processor 1140; and an LA7612 video signal processor produced by 
Sanyo for providing the functions of VSP 1155. 

5 In accordance with the present invention, the main microprocessor 

1110, under the supervision of the control programs contained within 
memory EEPROM 1127, will direct the video signal processor 1155 to 
provide the proper drive levels to the display, via the bus I 2 C BUS. As 
shown in the processing steps of Fig. 2, as the video signal processor is 

10 providing drive current for picture rasters, the main microprocessor 1110 
will first determine which region the rasters belong to. A region, for 
example, may be a main or subpicture in the PIP mode. As discussed 
above, the main picture may be displaying the TV images and the 
subpicture of the PIP may be showing internet text and/or graphics or an 

1 5 EPG, or vise versa. 

The microprocessor 1110 will then determine whether the material 
being displayed is: 1) a computer text/graphics image such as information 
obtained from the internet, 2) a television broadcast image, or 3) an OSD 

20 information such as an EPG, as shown in steps 210, 220 and 230 of Fig. 2. 
The main microprocessor 1110 makes this determination by coordinating 
and monitoring the operations of the OSD processor 1117, CPU 1112, and 
the Auxiliary Data Processor 1115. The main microprocessor 1110 will 
then provide a control signal to the video signal processor so that the 

25 video signal processor 1 155 can provide the desired video drive level to 
the display for the particular material being displayed during the 
associated scanning interval. 

In addition, Figure 1 includes a control switch 1118 coupled to 
30 microprocessor 11 10. The control switch 1118 can be used to select the 
mode of operation for the television set. For example, when a user selects 
the "auto mode", the television operates automatically to adjust the image 
characteristics of the drive signals for each display region as described 
above. When the switch is in the "manual mode 1" position, the user may 
35 only adjust the image characteristic of the entire screen. When the switch 
is in "manual mode 2" position, the television may provide a prompt for 
the user to select the desired image characteristic for each region. This 
aspect of the invention will be further described in regard to a PC 
implementation shown in FIGS. 3 and 4. 

40 
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Fig. 3 shows another example of an electronic device implementing 
a video drive control system in accordance with the present invention. 
The example is a computer system having a television tuner card 
installed in one of its computer card slots. 

5 

The computer system 10 is under the control of a CPU processor 
110. The computer includes a display processor 130 for controlling a 
kine drive 135 of an associated display monitor 136. The display 
processor 130, under the control of the CPU processor 1 10 via a computer 
10 operating system to be discussed later, provides for each pixel a desired 
video drive level. 

The computer system 10 includes a television tuner card 100 for 
receiving television signals to be displayed. It is known, for example, to 

15 be able to concurrently display a television image in one of the windows 
under, for example, a windows based operating system, while performing 
other computing applications in other windows, as shown in Fig. 5B. An 
example of an expansion card having a TV tuner that can be used with an 
IBM-compatible PC is "All-In-Wonder"™ card made by ATI Technologies 

20 Inc., of Canada. 

FIG. 4 shows in a flowchart form a feature of the system shown in 
FIG. 3. In Fig. 4, the operating system of the PC has a video processing 
subroutine 400 to provide the proper display drive control for each pixel 
25 of the display according to the principles of the present invention. 

The operating system which contains the video processing 
subroutine 400, provides to the display processor 130 intensity 
information such as contrast and brightness characteristics about each 
30 pixel, as each pixel is being displayed on the display monitor 136 in the 
display scanning process. This intensity information typically 
corresponds to R, G, and B drive levels for each pixel on the display. 

The operating system knows the location and the boundary of the 
35 windows or regions since the operating system is responsible for 
coordinating the resources among the different applications being 
displayed. Therefore, as each pixel is being displayed in the CRT 
scanning process, the operating system first determines which region or 
application this pixel belongs to, as shown in Step 401. 

40 
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Once this is determined, the operating system then obtains a 
normal drive level (X) for this pixel from the corresponding application 
program as shown in step 402. The drive levels (X) for a pixel in an 
application are normally represented internally as numbers, which can 
5 be represented as fractions of the maximum drive level. These might 
be thought of, for example as 0, 0.25, 0.50, 0.75, and 1.00, although 
many more levels are usually incorporated. 

To exert the required control of regions in accordance with the 
10 type of the material or information being displayed, these drive 

numbers, received from the application being displayed in a window, 
would be multiplied by a second number Y as shown in step 403. The 
second number Y is an attenuation number associated with the window 
currently being scanned. For example, the high-drive picture regions 
15 corresponding to real-world photographic style or television broadcast 
images might have an assigned attenuation number Y of 1.0 (no 
attenuation), but the computer-related text/graphics regions might 
have an assigned attenuation number Y of 0.25 (4 to 1 attenuation). 

20 Each pixel appearing in a window, which is of a certain type, is 

thereafter assigned an associated, final, attenuation level or a drive 
signal level Z. This level, Z, is derived from, for example, the 
multiplication of the normal application video level X for each pixel in 
the region by the assigned attenuation number Y for that region or 

25 window, resulting in independent control of each region's video level 
appropriate for its type of material being presented, as shown in step 
404. This number Z is then provided to the display processor 130 
which will drive the kine drive 135 and the associated display 136 at 
the appropriate level for each pixel. This process is then repeated for 

30 each pixel of the displayed image until the system 10 is turned off. 

In accordance with another aspect of the present invention, the 
system shown in FIG. 3 may provide a user interface feature to provide 
user adjustment of the final drive level for each window or application 
35 on the screen. This function is similar to that described above when 
switch 1118 of the television shown in FIG. 1 is in "manual mode 2" 
position. 

FIG. 6, steps 600 to 606, show in flow chart form, a user interface 
40 feature according to the present invention. The feature illustrated in 
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FIG. 6 may be implemented as a subroutine of the operating system 
that is exercised by CPU 1 10 of the system shown in FIG. 3. The user 
can, for example enter a key on a keyboard (not shown) of the 
computer system 100 to invoke this feature, as shown in Step 600. 
5 Thereafter, the computer system 100 will prompt the user via the 

display screen 136 to enter a new, overriding attenuation number Y for 
each region shown on the screen, as shown in Step 603. Once a number 
is entered by the user, the computer system overrides the old 
attenuation number Y previously derived by the CPU processor with 
10 this new number Y, thereby causing the final drive level Z for this 
particular window to be adjusted according to the user's taste. Thus 
the user is able to manually adjust the drive level for each of the 
regions currently being displayed on the computer screen. 

15 The above described concepts according to the present invention 

can be extended, if desired, to several levels of control for numerous 
types of presentation materials, to optimize the drive level of each region, 
according to the content. 

20 It is to be understood that the embodiments and variations shown 

and described herein are for illustrations only and that various 
modifications may be implemented by those skilled in the art without 
departing from the scope and spirit of the invention. 

25 
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CLAIMS 

1. A video processing system for providing an image having more 
than one region (501, 502; 510, 520, 530) on a display (DISPLAY; 136), 

5 wherein said system comprising: 

video driver means (1155; 135) for providing to said display an 
image signal having contrast and brightness characteristics; 

a control means (1110; 110) for determining for each region the 
type of the image material being displayed in said region and for 
10 generating a control signal causing said video driver means to adjust said 
contrast and brightness characteristics of said image signal according to 
the type of material being displayed in said region. 

2. The system in claim 1 wherein said type of material being 
15 displayed is either computer generated text/graphics or television 

broadcast image. 

3. The system in claim 2 wherein said control means (1110; 110) 
causes said video driver means (1155; 135) to lower said contrast and 

20 brightness characteristics of said image signals for said region, when said 
control means determines that said image material being displayed in 
said region is computer generated graphics/ text instead of television 
broadcast image. 

25 4. The system in claim 1 wherein one of said regions is a main 

picture and the other region is a subpicture. 

5. The system in claim 1 wherein said control means determines a 
normal drive level (X) for each pixel and an attenuation number (Y) for 

30 each region of said image being displayed, said attenuation number (Y) 
corresponding to the type of image material being displayed. 

6. The system in claim 5 wherein said control means further 
derives an attenuation level (Z) from said normal drive level (X) and 

35 attenuation number (Y), said video display driver generates said contrast 
and brightness characteristics according to said attenuation level (Z). 
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7. A method for providing a displayed image having more than one 
display region comprising the steps of: 

determining, for each region, the type of information being 
displayed; 

deriving, for each region, a drive signal level for said region 
according to said type of information being displayed; 

generating image signals with contrast and brightness 
characteristics corresponding to said drive signal level. 

8. The method in claim 7 wherein said type of information being 
displayed is either computer generated text/graphics or television 
broadcast image, 

15 9. The method in claim 8 wherein said generating step further 

comprises the step of lowering said contrast and brightness 
characteristics of said image signals for said region, when said control 
means determines said image material being displayed in said region is 
computer generated graphics/ text instead of television broadcast image. 



10 



20 



10. The system in claim 9 wherein one of said regions is a main 
picture and the other region is a subpicture in a PIP mode. 



1 1. The system in claim 10 wherein the step of deriving said drive 
25 signal level further comprises the step of obtaining a normal drive level 

(X) for each pixel and an attenuation number (Y) for region of said image 
being displayed, 

12, The systenMn claim 11, wherein said drive signal level for said 
30 pixel is derived by multiplication of said normal drive level (X) and 

attenuation number (Y). 
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13. Apparatus comprising: 

video signal processing means (1155; 135) for providing an image 
signal suitable for coupling to a display for providing a displayed image 
5 having more than one region; said image signal having contrast and 
brightness characteristics; 

a control means ( 1 1 10; 1 10) for determining for each region the 
type of image information being displayed in said region; 

said control means, in response to a switching signal (1118), having 
10 a first mode of operation (AUTO) during which said control means 

generates a first control signal causing said video signal processing means 
to adjust said contrast and brightness characteristics of said image signal 
automatically according to the type of information being displayed in said 
region, and a second mode of operation (MANUAL MODE 2) during which 
1 5 for each region said contrast and brightness characteristics are modifiable 
by a user. 

14. The system in claim 13 wherein said control means having a 
third mode of operation (MANUAL MODE 1) during which the contrast 

20 and brightness characteristics of said image signal are adjustable with 
respect to the whole image rather than region by region. 
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